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COMMUNICATIONS ROUTING 
This invention relates to routing in communications networks. 

5 In a packet switched network, such as the Internet, it is desirable to allow a host that is 
wirelessly connected to the network, to change its point of attachment to the network 
Such a point of attachment is called an access node (also sometimes called a base 
station) and such a host is called a mobile host. It is further desirable to allow the mobile 
host to change its access node during a data transfer without requiring reconfiguration by 
10 the user. A change in access node while connectivity is maintained is known as 
handover. 



The International Patent Application published as WO01/06717 describes a handover 
method. Before handover, data packets destined for a mobile host are forwarded to the 
15 mobile host from a ore-handover access node known as an old access node. During 
handover, a link is established between the mobile host and a post-handover access node 
known as a new access node. Subsequently a routing update is sent from the new 
access node to the old access node and the link between the mobile host and the old 
access node is torn down. 



20 



There will be a period of time before the routing update has reached the old access node 
when data packets continue to arrive at the old access node even in situations where the 
link between the mobile host and old access node has been torn down. Therefore a 
temporary, short-term tunnelling mechanism is provided whereby data packets destined 
25 for the mobile host and arriving at the old access node are encapsulated in the payload 
field of an outer packet and sent to the new access node. At the new access node the 
data packet is decapsulated and forwarded to the mobile host. 

The International Patent Application published as WO01/61934 describes a handover 
30 method known in the art as 'soft-handover' whereby the mobile host is able to 
communicate with both the old and new access nodes during handover. Under such a 
cond.t,on, data packets arriving at the old access node are 'bi-cast' so that they reach the 
mobile host directly via the old access node as well as indirectly via the tunnel .eading 
from the old access node to the new access node. Bi-casting is a process where identical 
35 data is transmitted simultaneously to two different destinations. 
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The problem with both these handover methods is that, physically, data packets are likely 
to traverse some of the same links twice leading to additional overhead. For example, the 
first link of the tunnel is likely to be the same as the final link to the old access node. 
Therefore, data packets will traverse this link once en-route towards the old access node 
and once in encapsulated form en-route from the old access node to the new access node 
via the tunnel. Furthermore, data packets (and their copies) will arrive at the new access 
node significantly later than at the old access node and this can lead to problems such as 
data packets being received out of order at the mobile host. 

"Cellular IP" (see <draft-ietf-mobileip-cellularip-OO.txt> of the Internet Engineering Task 
Force) introduces a concept of 'semi-soft' handover in which data packets are bi-cast to 
the old and new access nodes upon reaching a node (hereinafter the branching node) 
where the paths to the old access node and new access node diverge. 



15 



In a Cellular IP network there is one node, the gateway node, that connects the Cellular IP 
network to another IP network. In Cellular IP all the traffic originating from a mobile host 
must pass through this gateway node even if it is communicating with another mobile host 
within the Cellular IP network. Where an intra-network communication such as this is 
20 taking place, each mobile host will send packets along a path leading from the mobile host 
to the gateway node. The gateway node will then forward these data packets down a 
path towards the other mobile host. The two paths will diverge at some point - in 
situations where this point is not the gateway node itself, each data packet will travel back 
and forth along the shared path between the gateway node and the branching node at 
25 which the paths diverge again leading to additional overhead. 

According to a first aspect of the present invention there is provided a method of routing 
packets in a packet network, said packet network including a chain of packet nodes, said 
chain comprising first and second access nodes for communicating with one or more 
30 mobile nodes and one or more intermediate packet nodes, said one or more intermediate 
packet nodes providing a path interconnecting said first and second access nodes, said 
method comprising the steps of: 

installing, in said intermediate packet nodes, first routing data defining a first 
routing path in one direction along said chain to a mobile node via said first access node 
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and second routing data defining a second routing path in the opposite direction along 
said chain to said mobile node via said second access node; 
operating each of said intermediate packet nodes to: 

**ermine, on receipt of a packet destined for said mobile node, whether said 
5 packet is from another node on said chain or not; and 

a) if the packet is determined to be from a node not on said chain, copying the 
packe and routing said copy along one of said routing paths and routing said packet 
along the other of said routing paths; and 

10 said n„ „ b) , , " ^ PaCk6t ' S de,em " ned '° ^ an °' her node on said chain, route 
10 sa,d packet along said chain only in the direction in which it is currently travelling. 

By installing, in each node on a path extending from the old access node to the new 

aZr de . , r > r ,ino enwes prov,dina rou,es ,o a m ° bi,e n °* ■» *•*»» 

15 , e7 h ! 0Pera,in ° SaCh n0d6 '° PreVe "' 3 PaCke ' *»" »*• f °™*ed ^ong 

both to he old access node and fhe new access node thereby providing soft-handover 
wrthou. turning packets back along ft. link via which they arrived. This resute in a more 
efficient routing of packets. 



in preferred embodiment., the packe. carries a unique add re ss of the ntobiie node and 

frTH 7 Unk,Ue a *" eS8 IS ^ Same **" 8nd a " er 3 handorer * •» ■»«• "Ode 
from the tirst access node to ft. second access node. In this way there is no need to se, 

up and tear down connects between the mobile node and access nodes each erne me 

25 Z T, mWeS ' " W ° U ' d be reqUir6d in a " As * n *°"<»* Transfer Mode (ATM) 
25 network, for example. v ' 

Preferably the method further comprises operating each node in the packet network: 

a) to associate a routing value with said unique address; 

b) responsive to the receipt of said packet at said node to forward said packet 
30 towards another node having a lower routing va,ue associated w«h said unique address 

o) responsive to the creation of a wireless link between a mobile node having 
sa,d untque address and said node to reduce said routing vaiue associated w«h 2 
unique address to a lower value than tha, associated with said unique address by the 
other nodes in said network. y 
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This allows the amendment of routing tables for the mobiles address to be restricted to an 
area localised around the location of the mobile node. In other embodiments, packets 
might be forwarded to nodes having higher routing values for a given address and the 
creation of the wireless link could result in the provision of a higher routing value than 
5 found elsewhere in the network. 

Preferably the first routing data is installed prior to the handover of said mobile node. In 
this way, packets can be routed to the mobile node before handover. 

10 Preferably the second routing data includes data indicating that the second routing data 
relates to the handover of the mobile node. This ensures that packets are only sent down 
paths defined by the most recently received routing data. 

Preferably the second routing data is installed in response to a routing control message 
15 generated at the post-handover access node. Thus even if the link between the mobile 
node and the pre-handover access node is broken before the link between the post- 
handover access node and the mobile node is made, the routing can still be updated. 

According to a second aspect of the present invention there is provided a packet network 
20 including a chain of packet nodes, said chain comprising: 

first and second access nodes for communicating with one or more mobile 
nodes; and 

one or more intermediate packet nodes providing a path interconnecting said first 
and second access nodes; 
25 said intermediate packet nodes having installed therein first routing data defining a first 
routing path in one direction along said chain to a mobile node via said first access node 
and second routing data defining a second routing path in the other direction along said 
chain to said mobile node via said second access node 

each intermediate packet node being arranged in operation to determine, on receiving a 
30 packet destined for said mobile node, whether said packet is from another node on said 
chain or not and 

a) if the packet is determined to be from a node not on said chain, copying the 
packet and routing said copy along one of said routing paths and routing said packet 
along the other of said routing paths; and 
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said „ y. , " PaCket " determ ' ned '° bS *"" another "«*» « said chain, mute 
sa,d packet along ^ cnain on|y h ^ |n ^ ^ ^ cuTOn(|y 

According ,o a third aspect of the present invention there is provided a packet node for 
5 use ,n a packet network according ,o the second aspect of the present invention 

According to a, our* aspect of the present invention there is provided a digita, data carrier 

ZT Pro9ram t " eXeCU,abte ^ * •~ *> P-*™. *e 

method steps as set out in the first aspect of the present invention 

10 

Further aspects and advantages ofihe invention wii, become appamntfrom embodiments 

rirr^ b> way ° f — •* - 
1 5 r bT s :r: y :r r^:r" - a " — in ~ - 

, F,gure 2 schematically iflusbWe, a routing protoco, data table heid in a rouflng node in 
accordance with an embodiment of the invention; and 

Figure 3 illustrates a next-hop forwarding table held in the routing node in accordance with 
20 an embodiment of the invention. accordance wrtn 

Figures 4 to ,2 schematically iflustrate handover and the accompanying muflng updates 
in accordance with an embodiment of the present invention 

Figures 13 and ,4 illustrate the restoration of muting to a home base station in 
accordance with an embodiment of the invention- 
25 Figures 15 to ,7 illustrate inter-base station handover and the accompanying routi „ 3 
updates ,n accordance with a further embodiment of the invention- 
Figures^ to 21 are flow charts illustrafing how a node reacts to'receiving dflferen, types 

W e R moodim 7 IT^ 1 ' " eXamPte *•*•***«• ''."logy In accordance with an 

examl T t ^ ' nTOn,i ° n * ^ **—. by way " 

exampie, three packet switching networks 2, 4, 8 forming an Autonomous System (AS) 
One defln,,,on given for the ferm Autonomous System, is -a se, of roulers and Z1Z 

35 Ha T£ adm ' ni ~ r™"* in »• Christian Huitema, 

35 Ha, ^ 158 , HeI *, „ tenn Autonomous as ~ 
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domain in the art, is also intended to mean a network, or a set of networks, having routers 
running the same routing protocol. An Autonomous System may be connected to other 
Autonomous Systems forming a global inter-network such as the Internet (used by way of 
example hereinafter). The routing protocol is an interior gateway protocol, and 
5 communications with other Autonomous Systems are achieved via exterior gateway 
protocols such as the Border Gateway Protocol (BGP). Examples of known interior 
gateway protocols are the Routing Information Protocol (RIP) and Open Shortest Path 
First (OSPF). 

10 The networks 2, 4, 6 forming a fixed infrastructure of the Autonomous System include a 
plurality of Internet Protocol (IP) packet switching nodes in the form of a plurality of Core 
Routers (CR), a plurality of Edge Routers (ER) and Bridge Routers (BR) interconnecting 
the different networks 2, 4, 6 in the AS. All of these packet switching nodes run a single 
IP routing protocol, one embodiment of which is to be described in further detail below. 

One or more Exterior Gateway Routers (EGRs) connect the Autonomous System to 
further Autonomous Systems of the global Internet. 

The Autonomous System illustrated in Figure 1 performs routing for both mobile hosts, for 
20 which routing within the AS is altered as a result of mobility of the mobile, and fixed (i.e. 
stationary) hosts, for which no such routing alterations occur. 

Mobile nodes may be connected to an Edge Router via a wireless link, in the example 
shown, a cellular radio link (a further possible type of wireless link is an infra-red link) 

25 using a Base Station (BS) Router provided by a mobile network operator. The cellular 
radio link may be a Time Division Multiple Access (TDMA) system link, such as found in 
"Global System for Mobile Communications (GSM)* networks, or a Code Division Multiple 
Access (CDMA) system link, such as found in "CDMA 2000" networks. Mobile nodes take 
the form of individual mobile hosts 14, and/or mobile routers 16 having a plurality of hosts 

30 attached thereto, each of which conduct radio communication with one or more of the BSs 
at any given time. A BS may control a number of Base Transceiver Stations (BTSs) which 
are co-located with radio antennae around which individual "cells" of the cellular system 
are formed 
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ntaort. If a BS sen,es a number of ce„s, a mobi,e node handed over between ce»s may 

lleT reCe " e Pa0k6t da ' a ^ ^ BS ' H0WeVer ' °" Ce a m °* «* "-"ves 
oute.de the range of a BS via whioh „ Is receiving service, handing over ,o a new eel, may 

necessrtate a change of roufing within the AS. Date packets originating from and destined 

to the mtf* node in question, a re routed, using me IP address of the node, via a given 

sanTlP r QOVer ' F °" 0Win9 hand0V6r ' *"* d3,a PaCke,S re "* a — * •» »e 
ams IP addiass. via a different BS. A mobile node may be participating in a 

communications session with a different host via the AS during handover from one BS ,o 

conToT TT COnneC "° nS * *• tranSP ° rt byer ( ' n ' ** eXam " te ' a tra " s ^-n 
comro, protocoirinteme. protocol (TCP/iP, connection) are defined in part by the IP 

address of fhe mobile node, such a change in routing is desired to allow such connections 

us,n9 same ,p address when 3 mobile n °* - • 



15 



Rxed hoas may be connected to an Edge Router via a Local Area Network (LAN) ,0 
running a locel area network protocol such as an Ethernet protocoi. Fixed hosts may also 
be connected to an Edge Router via a Public Switched Telephone Netwo* (PSTN) 12 

20 Z ^n I SWVW <NAS) 20 ^ * a " access pro ider The 

20 NAS 20 dynamic^ allocates fixed ,P addles on a dial-up basis to fixed ho^s 
connecfing to ma NAS 20 using a protocol such as -Point to Point (PPP,- or 

^ < SLIP > ■ « ™- aa originating from, or dLed to, e £ 

fixed host v,a an associated Edge Router. Whilst the NAS 20 allocates IP addresses on a 
dynam,o basis, the Edge Router via whioh packets are routed for me aiiocated IP aZe 
25 does no. change, either durtrg an access session or over a longer-term period tTs 
routing w„ hin the AutonomoU8 Sys , em ^ need (o ^ 

rag" °' ^ — '° - AS - a = - ~» or tH 

30 The interior gateway protocol, me single IP routing protocol used in the AS in this 
embodin™, of the present invention is a modified version of the Temporal^ de^d 
Roofing Algonthm (TORA, routing protocol, which is described in, inter alia "A Hoht 

M Scott Corson, Proceedings of INFOCOM W . April 7-11, Kobe, Japan- and -A 
35 Per,™ Comparison of the Temporaliy-Ordered Routing Algorithm and "deal Link 
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State Routing" Vincent D Park and M Scott Corson, Proceedings of 1SCC "98, 30 June - 2 
July, 1999, Athens, Greece. 

The TORA routing protocol algorithm executes distributedly, provides loop-free routes, 
5 provides multiple routing (to alleviate congestion), establishes routes quickly (so they may 
be used before the topology changes), and minimises communication overhead by 
localising algorithmic reaction to topological changes when possible (to conserve available 
bandwidth and increase scalability). 

10 The algorithm is distributed in that nodes need only maintain information about adjacent 
nodes (i.e. one hop knowledge). It ensures all routes are loop-free, and typically provides 
multi-path routing for any source/destination pair which requires a route or a plurality of 
routes. Since multiple routes are typically established, many topological changes do not 
require routing updates within the AS since having a single route is sufficient. Following 

15 topological changes which do require routing updates, the protocol re-establishes valid 
routes. 

The TORA protocol models a network as a graph G = (N, L), where N is a finite set of 
nodes and L is a set of initially undirected links. Each node i e N has a unique node 
20 identifier (ID), and each link (i, j) € L allows two-way communication (i.e. nodes i and j, 
which are connected by a link, can communicate with each other in either direction). Each 
initially undirected link (i, j) e L may subsequently be assigned one of three states; (1) 
undirected, (2) directed from node i to node j, or (3) directed from node j to node i. If a link 
(i, j) e L is directed from node i to node j, node i is said to be "upstream" from node j while 
25 node j is said to be "downstream" from node i. For each node i, the "neighbours" of i, ty e 
N, are defined to be the set of nodes j such that (i, jj e L. Each node i is always aware of 
its neighbours in the set Nj. 

A logically separate version of the protocol is run for each destination (identified by a host 
30 IP address for example) to which routing is required. 

The TORA protocol can be . separated into three basic functions: creating routes, 
maintaining routes, and erasing routes. Creating a route from a given node to the 
destination requires establishment of a sequence of directed links leading from the node 
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to the dest.nat.on. Creating routes essentially corresponds to assigning directions to links 
in an und.rected network or portion of the network. The method used to accomplish this is 
a query/reply process which builds a directed acyclic graph (DAG) rooted at the 
dest.nat.on (,.e. the destination is the only node with no downstream links). Such a DAG 
may be referred to as a "destination-oriented" DAG. Maintaining routes involves reacting 
to topological changes in the network in a manner such that routes to the destination are 
re-estab.,shed. Upon detection of a network partition (i.e. when a network has been split 
into multiple parts), all links (in the part of the networK which has become partitioned from 
the destmation) are marked undirected to erase invalid routes. 

The protocol accomplishes these three functions through the use of three distinct control 
packets: query (QRY), update (UPD), and clear (CLR). QRY packets are used for creatine 
routes, UPD packets are used for both creating and maintaining routes, and CLR packets 
are used for erasing routes. 



At any gwen time, an ordered quintuple, referred to as a "height-, H, = („, oid, r, 5 i, is 
associated with each node i e N. Conceptually, the quintuple associated with each node 
* represents the heigh, of the node as defined by hvo parameters: a reference level and a 
delta wHh respect to the reference level. The reference level is represented by the first 
20 three values in the quintuple while the delta is represented by the las, two values A new 
reference level is denned each time a node loses its last downetream link due to a link 
fa-lure. The firs, value representing the reference level, x„ is a time tag set to the time" of 
the link failure. The second value, oid„ is fine originator-ID (i.e. me unique .0 of toe node 
wh,ch defined ,he new reference level,. This ensures that the reference levels can be 
25 totally ordered lexicographically. The third value, r„ is a single bft used to divide each of 
the un,que reference levels into «wo unique sub-levels. This bit is used to distinguish 
between toe original reference level and ils corresponding, higher reflected referanco 
level. The firs, value representing the delta, 8, is an integer used to enter nodes with 
respect to a common reference level. This value is instarmental in the propagalion of a 
30 reference level. Finally, ,he second value rapresennng toe delta i, is toe unique ID of toe 
node M This ensures toa, nodes wito a common referance level and equal values of 8, 
(and ,n fact all nodes) can be totally ordered lexicographically a, all times 
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Each node i (other than the destination) maintains its height, Hi. Initially the height of each 
node in the network (other than the destination) is set to NULL, H = (-, - i). 
Subsequently, the height of each node i can be modified in accordance with the rules of 
the protocol. In addition to its own height, each node i maintains, in a routing protocol 
5 data table, entries against host IP addresses having an existing DAG in the network, the 
entries including a height array with an entry HNg, for each neighbour] e N s . 

Each node i (other than the destination) also maintains, in the routing protocol data table, 
a link-state array with an entry LSy for each link (i, j) e L. The state of the links is 
10 determined by the heights Hi and HN {j and is directed from the higher node to the lower 
node. If a neighbour j is higher than node i, the link is marked upstream. If a neighbour j 
is lower than node i, the link is marked downstream. 

The TORA protocol was originally designed for use in a Mobile Ad-Hoc Network (MANET) 
15 in which the routers are mobile and are interlinked via wireless links. However, in this 
embodiment of the invention a modified TORA protocol is used in an Autonomous System 
including a fixed infrastructure of fixed routers interconnected by fixed links, such as that 
illustrated in Figure 1, to provide for routing alterations in the fixed infrastructure when a 
mobile host alters its point of attachment to the infrastructure. 

20 

Figure 2 illustrates schematically an example of a routing protocol data table which may 
be held in a router in accordance with this embodiment. 

Against each host IP address (or address prefix in the case of an aggregated DAG, to be 
25 described in further detail below) IP1, IP2, etc having a DAG in the network is stored the 
primary height of the storing node Hi(IP1), Hi(IP2), etc. Also, the identity of each adjacent 
neighbour for example w, x, y, z and that neighbour's primary height HNjw(IP1, IP2, etc), 
HNix(IP1, IP2, etc), HNiy(IP1, IP2, etc) and HN^IPI, IP2, etc). Also the link-state array for 
each IP address (or prefix) may be stored in the form of markings signifying an upstream 
30 link (U), a downstream link (D), or an undirected link (-) against each primary link identity 
(L1, L2, L3, L4) corresponding to each neighbour. For each adjacent neighbour w, x, y, z, 
that neighbour's secondary height HNiw:S(IP1, IP2, etc), HN ix :S(IP1, IP2, etc), HNiy:S(IP1, 
IP2, etc) and HN te :S(IP1, IP2, etc) is further stored. Finally the secondary link-state array 
for each IP address (or prefix) may be stored in the form of markings signifying an 
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upstream .ink (U), a downstream link (D). or an undirected link (-) against each secondary 
link identity (L1 :S, L2:S, L3:S, L4:S) corresponding to each neighbour. 

The link-state array held in the routing protocol data table allows a next-hop forwarding 
5 decision to be made locally in the router holding the data. For a sufficiency 
.nterconnected network, each router shou.d have at least one downstream link. If only 
one downstream link exists, that link is selected as the next-hop forwarding link. If more 
than one downstream link exists, an optimum downstream link may be selected for 
exampfe on the basis of current traffic loading on the two links. In any case, the selected 
0 hnk ,s entered into a next-hop forwarding data table against the IP address A next-hop 
forwarding table, such as that il.ustrated in Figure 3, is held in cache memory for fast 
access as IP packets requiring routing arrive at the router. The table stores the primary 
next hop forwarding link (L2, L1 , etc) selected and the secondary next-hop forwarding link 
(Li .s, L2.S, etc) selected, against each IP address (or prefix) IP1 , IP2, etc. 

5 

The use of a fixed infrastructure of routers, and other aspects of the invention to be 
descnbed below, allow for routing aggregation within the AS, in particular for the IP 
addresses of mobile hosts. What follows is a brief description of IP addressing in 
particular how variable length prefixes are used to provide routing aggregation in an IP 
0 routing network. 



IP addresses currently consist of a predetermined number (32) of bits. IP addresses were 
m the past al.ocated on an unstructured basis (referred to as a "flat" addressing plan) 
Oassfu. addressing introduced the concept of a two level routing hierarchy by splitting 
addresses into network prefix and host fields. Users were al.ocated IP addresses as 
erther a class A, class B or class C to simplify routing and administration. 

in class A, bit 0 identifies class A, bits 1-7 identify network (126 networks) and bits 8-31 
. identify host (16 million hosts). 

IT, B '.T! °" 1 C ' aSS B ' * 2 " 15 " etwork < 16 ' 382 "~> and b„s 

16-31 identify host (64,000 hosts). 

Itr^T.rK^ C ' aSS °' * 3 " 23 ^ "*"* < 2 ' 097 ' 152 ~*> and 
bits 24-31 identify host (256 hosts). 
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A two-level hierarchy still left a flat routing hierarchy between hosts within a network. For 
example, a class A address block could have 16 million hosts which would result in all 
routers within the network containing 16 million routing table entries. Subnetting was 
5 developed to allow a host address block to be split into a variable length subnet field and 
host field. This allows routers within an AS to keep routing table entries for subnets only 
(providing the aggregation of routing for all the hosts on each subnet). A subnet mask is 
used to enable routers to identify the subnet part of the address. 

10 In accordance with this embodiment of the invention, routing aggregation is provided by 
assigning a host IP address block (i.e. a contiguous sequence of IP addresses sharing 
one or more prefixes) to a BS, and dynamically allocating IP addresses from within the 
block to mobile hosts for the duration of their access sessions. When a mobile host 
registers with the cellular network on power up, the serving BS allocates an IP address 

15 and caches a binding between the mobile host's wireless link identifier and the allocated 
IP address. An aggregated routing plan (in this embodiment an aggregated DAG) is pre- 
computed within the AS before the mobile host is allocated the IP address it uses 
throughout its access session. Following power down of the mobile host, the IP address 
is returned to the owning BS, which may then allocate the IP address to another mobile 

20 host. Mobile host IP addresses allocated by a BS will have an aggregated DAG, until at 
least one of the mobile hosts moves away, in which case the aggregated DAG will remain 
in place, but a host-specific exception will be created on the routers affected by a mobility- 
specific routing updating procedure (the update only changes routing for the single mobile 
which has moved away). 

25 

Pre-computation of routes in an AS for address prefixes owned by a BS is achieved by the 
owning BS injecting an update message, referred to herein as an "optimisation" (OPT) 
packet, for each prefix, which update message floods out across the AS and effectively 
acts as a prefix announcement as well as building the aggregated DAG. The OPT packet 

30 is transmitted by the BS owning the IP address prefix, or prefixes, and controlling the 
aggregated DAG. The OPT packet is propagated to all other nodes in the network 
(regardless of their current heights (if set)), (re)setting these heights to the "all-zero" 
reference level, that is to say the first three values (Ti, oidj, n) of the TORA heights are all 
set to zero. The fourth height value, 8,, is set to the number of hops taken by the OPT 

35 packet since transmission from the BS (this is similar to UPD packet propagation in known 
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TORA source-initiated DAG creation mechanisms). An increment of 1 may be added to 
represent the hop from the BS to the mobile host. The fifth height value, I, is set to the 
packet switching node ID. 

5 Onoe an aggregated DAG exists in the AS. each packet switching node in the AS has a 
next-hop fonvarding table entry for the IP address prefix in question. When a packet 
amves at a node which requires routing, the node searches its next-hop forwarding table 
for the longest matching address entry on which to base the next routing decision, which 
proving the mobiie host using the IP address has no, moved away from the owning BS 
10 w, be me IP address prefix. By providing for aggregated DAGs wtthin the AS. ring 
table s,ze and rouong processing may be minimised at each packet switching node. 

However when a mobile host is handed over a, the wireless link layer away from the BS 

15 t TT1 reCelVe<i ^ ^ a " host -*y * -eated 

JTr » T. 9 Pr ° ,OC01 ** ^ neX, - h ° P ~ n » «* < a 

number of) packs, swriching nodes affected by routing updates caused by the mobiltty o, 

the mob,le node. These nodes continue to store the corresponding aggregated address 
entries, n use me M address ^ for ^ ^ ^ ^ ^ 

host by virtue of a longest match search. 

0 

The TORA heigh, maintenance algorithm falls into the same general class of algorithms 
ong,na„y denned in "Distributed Algorithms far GeneraHng Loop-Prce Routes in Nettvor* 
w«h Frequently Changing Topology. E Gafai and D Bettsekas, IEEE Trans. Common 
anuary 1981. w*h,n mis dass, a node may only -increase" «s heigh,; , may neve 

hei9h !, . However ' in ,his embodimen, * the an 

mutton s provided ,o ensure that. after a handover, a node's forwarding behaviour is 
«* ma,, when a plurality of rouling interfaces to neighbouring nodes exist. . forwands 
packete over a routing interface ,o a neighbouring node from which a mobi„,y-re,a,ed 
routing update was most recentty received. The t time value in the heigh, quintuple (, 

in ,he rouler ' s rou,in9 pro,oeo1 data teb,e as an «— «- -ob, te 

node s IP address and ,he neighbour in question is permitted ,o become -negate" i e 
tess man zero. ,o indicate a mobility-related update having occuned. and ,he magnttude of 
me negate x lime value increases for each occunence o, a mobilfty-related routing 
update for a given IP add re ss. Thus, me mos, recen, mobimy-related update is indill 
by me more negative , time value, tt is ,o be noted. ,ha, whils, mobilfty-related rou«ng 
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updates are distinguished by a negative x time value, other indicators may also be used, 
such as a one-bit flag, to replace the negative flag. 

When a mobile host changes BS affiliation, it decreases its height value by decreasing the 
5 x time value, for example by an integer, and the new value is propagated to a limited 
number of nodes in the AS as part of a mobile-initiated update of the DAG associated with 
the mobile node's IP address, to be described in further detail below. A node having 
multiple downstream neighbours routes onto the most recently-activated downstream link. 
The heights are still totally-ordered (hence routing loop freedom is preserved). 

10 

A detailed example of handover and routing updates within the fixed infrastructure of an 
AS will now be described with reference to Figures 4 to 12. In each of the TORA height 
quintuples illustrated in Figures 4 to 12, the packet switching node ID is depicted using the 
reference i, for simplicity. However, it will be appreciated that this value will be different 
1 5 for each packet switching node, so as to uniquely identify the packet switching node within 
the AS. It will also be noted that only a part of the AS is illustrated, for the sake of 
simplicity. 

In all of the following examples, the AS includes a plurality of fixed core routers (CR1 , 
20 CR2...), a plurality of fixed intermediate routers (IR1, IR2...), a plurality of fixed edge 
routers (ER1, ER2...) and a plurality of base station (BS1, BS2...), classified in 
accordance with their relative proximity to the topological "edge" of the fixed infrastructure. 
The core routers may be adapted to handle higher quantities of traffic than the 
intermediate routers, and the intermediate routers, in turn, may be adapted to handle 
25 higher quantities of traffic than the edge routers. For example, the core routers may 
handle national traffic, the intermediate routers regional traffic, and the edge routers sub- 
regional traffic. 

In the case of all of the examples described below, the hop-by-hop routing directionality at 
30 the interfaces is indicated by arrows marked along links between nodes of the network, 
and between access nodes and mobile nodes (which links include a wireless link). The 
distributed routing plan is in the form of a TORA DAG directed at a single receiving mobile 
host, MH2. Before the mobile host MH2 begins an access session, and is dynamically 
allocated an IP address, a pre-computed and aggregated DAG exists for the IP address 
35 within the AS, having been injected as an AS-wide update from the access node 
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allocating the IP address, node BS2. In Figures 4 to 17, nodes involved in routing 

updates or packet forwarding are marked with their TORA height quintuple (x f ,oi di r, 8, i) 
As previously described, this TORA height is also stored within the routing protocol data 
table of each neighbouring node, having been advertised to each neighbouring node from 
5 the node to which the height applies. 

When the mobile host MH2 registers with the home access node BS2, the home access 
node BS2 caches the identity of the mobile host MH2 at the wireless link layer against the 
IP address which is allocated, thus forming a mobile-spectfic entry in a routing table held 
10 in BS2. 

Figure 4 illustrates a communications session occurring between the mobile host MH2 
and two further hosts, MH1 and MH3. In the following examples, mobility of the 
correspondent mobile hosts MH1 and MH3 does not occur, although such mobility is 

15 poss,ble using the same functionality which is to be described in relation to the mobility of 
MH2. A s,milar communications session may also be conducted with a correspondent 
fixed host. Notably, a separate DAG exists within the AS directed towards MH1 and MH3 
whereby data packets originating from MH2 are routed to MH1 and MH3 As this DAG 
d.rected to MH1 and MH3 does not alter, and routing exists towards MH1 and MH3 from 

20 each access node which MH2 affiliates with, no further description of routing towards MH1 
and MH3 will be provided. 

Data packets originating from MH1 and MH3 and destined for MH2 are initially routed to 
the home access node BS2 via its aggregated DAG, for example via fixed nodes BS1 
25 ER1, ,R1, and ER2 for MH1 and BS4, ER4, «R4, CR4, !R3 and ER3 for MH3, as shown in 
Figure 4. 

Referring now to Figure 5, a handover decision may be made either by the mobile host 
MH2 itself, or by the node BS2. In the case of a mobile node-initiated handover the 
30 decision may be made based on a comparison of wireless link quality between signals 
rece,ved from the access nodes BS2 and BS3. As MH2 moves, the signal received from 
access node BS3 may improve, whilst the signal received from access node BS2 
worsens, and at a threshold decision event, MH2 responds by initiating a handover 
between nodes BS2 and BS3. In the case of a handover decision made at node BS2 the 
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decision may be made based on other considerations, such as traffic load. In such a 
case, the access node BS2 transmits a handover instruction to MH2. 

Whether the handover is initiated by the mobile host MH2 or the home access node BS2, 
5 the mobile host MH2 computes a new, secondary height of (-1,0,0,0,i):S. The ":S" 
indicates that this height is secondary. The fact that this height is secondary indicates that 
the old access node BS2 maintains control of the DAG for the IP address it originally 
allocated to MH2. The negative value, -1, of the x time value indicates a first mobility 
related routing update away from the home access node BS2. The new secondary height 
10 is then transmitted as part of a trigger message to the new access node BS3. The trigger 
message informs the new access node BS3 that control of the DAG for the IP address 
originally allocated to MH2 could be passed to it. 

Upon receiving the trigger message, the new access node BS3 interprets the trigger 
15 message as an instruction to generate a unicast directed Secondary Request (SR) 
packet. The SR packet is similar to an OPT packet and is processed and forwarded by 
the neighbouring routers. The SR packet is to travel along a unicast path between the 
new access node BS3 and the home access node BS2. What a node does in response to 
it receiving an SR packet will now be described with reference to figure 18. After receiving 
20 an SR packet (step 1801) the node adds an additional, secondary height into its routing 
protocol data table (step 1803). 

These secondary heights also have a negative t time value associated with the mobility 
update. Furthermore, the 5 value of the secondary height quintuple represents the 
25 number of hops to the mobile host MH2 via the new access node BS3. 

The node then transmits an advertisement of its new secondary height to each of its 
neighbouring node (step 1805), the propagation of these advertisements being limited to 
one hop. Each neighbouring node can therefore update its routing protocol data table 
30 with the new secondary height. If necessary, the node then updates its next hop 
forwarding table (step 1807) which, it will be remembered, is held in its cache memory. 
Finally, the node forwards the SR packet. 



35 



It will be realised that once a node has updated its routing protocol data table and next 
hop forwarding table to include secondary height information, it will have for each of one 
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or more IP addresses, two downstream links (a primary one and a secondary one) and 
therefore two entries in its next hop forwarding table. 

Referring to figure 19. upon receiving packets (step 1901), therefore, nodes will check 
5 (step 1903) their next hop forwarding table for multiple entries. If there is only one 
downstream link from that node and therefore only one entry in the next hop forwarding 
table then the packet will be forwarded down this link (step 1905). If, however there is 
more than one downstream link from that node and therefore multiple entries in'the next 
hop forwarding table then the node performs a further check (step 1907) to see if the 
0 packet arrived at the node down one of the links found in its next hop forwarding table If 
the packet did arrive via one of the indicated downstream links then it is not forwarded 
down this .ink and is rather only forwarded down the other links found in the next hop 
forwarding table (step 1909). This avoids the node merely reflecting a packet back-down 
he hnk on which it arrived. If, however, the packet was not received from one of these 
5 hnks then it is copied and a copy is forwarded down all the links found in the next hop 
forwarding table (step 1911). 

Referring once again to figure 5, new access node BS3 adds a secondary height of (- 
1.0.0.1.0:8 to its routing protocol data table, transmits an advertisement of this new 

"" nd " y hS ' 9ht '° its nel « hb ° urs <>.e. node ER3), updates its nex, hop forwarding table 
and forwards the SR packet to node ER3. 

Referring now to figure 6, node ER3 in turn adds a secondary height of (-1 ,0.0,2.i):S to its 
routing protocol data table, transmits an advertisement of this new secondary height to its 
. nerghbours <i.e. nodes ,R2, ,R3 and BS3). updates its next hop forwarding table and 
forwards the SR packet to node .R2. „ will be realised that despite node ER3 having two 
downstream links (a primary one directed towards node IR2 and a secondary one directed 
towards node BS3) and therefore two entries in its next hop forwarding table the SR 
packet was received from node BS3 and therefore the packet is not sent back down this 



TT,T - ^° WeVer ' r ° U,er WWOh Pr ° WldeS * e branChlns <» int betw »" •» routing 
path followed from the transmitting mobile host MH3 to the home access node BS2 and 

the routing path to be followed by packets transmitted from mobile host MH3 to the new 

access node BS3 (the routing path being estabiished). Data packets arriving at node ER3 
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from node IR3 and directed to the mobile host MH2 are copied and a copy is forwarded to 
node 1R2 along the primary link and another copy is also forwarded to node BS3 along the 
secondary link. 

5 Referring to figure 7, upon receiving the SR packet, node IR2 adds a secondary height of 
(-1 ,0,0,3,0:8 to its routing protocol data table, transmits an advertisement of this new 
secondary height to its neighbours (i.e. nodes CR1, CR2, ER2 and ER3), updates its next 
hop forwarding table and forwards the SR packet to only node ER2. It will be realised that 
despite node ER2 having two downstream links (a primary one directed towards node 

10 BS2 and a secondary one directed towards node IR2), the SR packet was received from 
node IR2 and therefore the packet is not sent back down this link. 

Node ER2 is, however, the router which provides the branching point between the routing 
path followed from the transmitting mobile host MH1 to the home access node BS2 and 
15 the routing path to be followed by packets transmitted from the mobile host MH1 to the 
new access node BS3. Data packets arriving at node ER2 from node IR1 and directed to 
the mobile host MH2 are copied and a copy is forwarded to node BS2 along the primary 
link and another copy is forwarded to node IR2 along the secondary link. 

20 Referring to figure 8, on receipt of the SR packet, the home access node BS2 may 
transmit a SR-acknowledgement (SR-ACK) towards the new access node BS3. The SR- 
ACK packet follows the secondary path established in the DAG towards the new access 
node BS3. Once the secondary DAG has been established, data packets directed 
towards the mobile host MH2 are forwarded to MH2 via the new secondary link from new 

25 access node BS3, in addition to data arriving at the mobile via the old primary link through 
home access node BS2. 

Subsequently, when the new link is preferred or the old link is lost, the mobile host MH2 
sends a message to the new access node BS3 indicating the loss of the connection to the 
30 old access node BS2. Since the old primary connection is lost, the old primary height 
associated with MH2 is lost too. MH2 therefore assumes its secondary height as its new 
height and includes it in the message. Handoff is triggered by the new access node BS3 
interpreting the message as an instruction to generate a unicast-directed update- 
secondary (UUPD-S) packet. 

35 
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The UUPD-S packet is similar to an OPT packet and is processed and forwarded by the 
ne,ghbouring nodes. The UUPD-S packet is to trave. aiong a unicast path between the 
new access node BS3 and the home access node BS2 updating the routing. The process 
for what a node does in response to it receiving a UUPD-S packet will now be described 
5 with reference to figure 20. 

After receiving a UUPD-S packet (step 2001), the node deie.es its old primary height entry 
fronts routing protocot date table (step 2003,. promotes its secondary heigh, entry (step 
2005, by removing .he ■» sum* and transmits an advertisement of Ks new heigh, ,o each 
of » ne,ghbou„ng nodes (step 2007), .he propagation o, these advertisements being 
tated to one-hop. Each neighbouring node can merefore update ite own roulr* p ro ,„col 
data table. The node then forwards the UUPD-S packet (step 2009, and finally updates 
its next hop forwarding table to reflect the new heights. 

1S Referring ,o figure 9, having received a message from the mobile host MH2. .he new 
acoess node BS3 generates a UUPD-S pacKet. The pacKe, causes the deletion of .he old 
he,gh entnes and the promotion of .he secondary heigh, entries (by removing the - S- 
suffix, „ ite roudng protocol data teble. Access node BS3 »en transmlte an 

20 umph T . hei9h ' *° " S TOi9hbOUrS (i e n ° de ER3 > a "« «-n forwards the 

tooted TT n0dS ER3 ' Rna " y aCCeSS ^ 683 ^ ^ ™« ** 
ho , MH2 6 ^ " ° n ' y ^ "* d0WnS,ream Bnk ' *- «— * •» ntobile 



25 



30 



On!T Zn J*"* 1 °' " ^ bS rememDer6d ,hat n0de ER3 is a "ode. 
Once the UUPD-S packe, has passed through node ER3 (and therefore once its rou,ing 

protocol da ,a table and nex, hop Warding table has been updated) node ER3 only has 

one downstream link. tha, directed towards the new access node BS3. Therefore packe, 

up ca on a, node ER3 ceases a, ,his time. The UUPD-S is forwarded «o the subset 

node along the un,cas, updating route, node IR2 and then to node ER2. 

OnlTr U..PH 1 " remembered n ° de ER2 iS als ° a inching node 

One. ft. UUPM packe, has passed trough node ER2 (and therefore once its routing 
protocol date teble and nex, hop forwarding teble has been updated, node ER2 onTyts 
one downstream link. .ha. directed towards acoess node IR2. Therefore p oke 
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duplication at node ER2 ceases at this time. The UUPD-S is finally forwarded to the old 
access node BS2. 

Referring to figure 12, on receipt of the UUPD-S message, the home access node BS2 
5 may transmit an update complete acknowledgement UUPD-S-Ack packet towards the 
new access node BS3. The UUPD-S-Ack packet follows the unicast-updated routing path 
established in the DAG towards the new access node BS3. On transmission of the 
UUPS-S-Ack packet, the old access node BS2 relinquishes control of the DAG for the IP 
address it originally allocated to the mobile host MH2. On receipt of the UUPS-S-Ack 
1 0 packet, the new access node BS3 takes control of the DAG for the IP address of the 
mobile node. 

The routing update associated with the handover of the mobile host at the radio link layer 
is now complete, involving the redefinition of the height of only a limited number of nodes 
15 (in the example in figure 12, only five nodes) along the unicast update path. 

Figures 13 and 14 illustrate a procedure whereby, when a mobile host MH2 loses its link 
to the new access node BS3 (having been connected to both the new access node BS3 
and the old access node BS2 as in figure 8), routing updates are performed which restore 

20 the DAG for the IP address of MH2 to the condition of the DAG before the IP address was 
originally allocated to MH2. The routing update procedure involves routing updates being 
transmitted to only a limited number of nodes in the AS (along the paths along which 
unicast mobility-related updates were previously transmitted), and updates are required in 
the routing protocol data tables of only a limited number of nodes (the nodes long which 

25 the restored directed routing update messages pass and each immediately adjacent 
node). 

Referring to figure 13, when the mobile host MH2 loses its link to the new access node 
BS3 (having been connected to both the new access node BS3 and the old access node 

30 BS2 as in figure 8), it sends a message to the old access node BS2 indicating that it has 
lost the secondary connection with the new access node BS3. (Since the secondary 
connection is lost, the secondary height associated with the mobile is lost too.) The old 
access node BS2 interprets this message as an instruction to generate a UUPD-S* 
packet. The reaction of a node to receiving a UUPD-S* packet will now be described with 

35 reference to figure 21 . 
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After recervrng an UUPD-S* packet (step 2101) me node deietes its additional, secondary 
herght from rts routing protocol data table (step 2103). The node then transmit an 
advertrsement of this deietion to each of its neighbouring nodes (step 2105) the 
5 propagation of these advertisements being iimlted to one hop. Each neighbouring 'node 

Zr<T r 7 Pda,e ,he ' r rOUSn9 Pr ° ,0CO ' da ' a ,able - nen - ,he «* * «ne 
UUPD-S packet towards the next node (step 2107) and finally „ updates fts next hop 
forwarding table (step 2109). 

10 Referring once again to figure 13. having received a message from the mobile host MH2 
mdrcabng a loss of connection with the new access node BS3. the old access node BS2 
generates a UUPD-S* packet ft dete.es its secondary hefcht from U routing protocol 
data table, fransmfts an advertisement of the deletion ,o its one-hop neighbours (,e 

is ZST ,owards ,he UUPM ' — to noda ER2 and — - - * 

Referring to figure 14, once me UUPD-S* packet has reached the branching node ER2 
, and once node ER2's routing protocol data table has been updated, packet duplication a, 

20 BS2 s .T 65 S ' nCe ^ ° nly ^ ° ne dOWnStream lin * that *>-* "0* 

20 BS2. S, m „afty, once the UUPD-S* packet has reached the branching node ER3 and once 

* roufng protocol data table has been updated, packet duplication a, node ER3 ceases 
s,nce node ER3 will only have one downstream ft* that towards node IR2. 

25 «<T 15 " 17 '" US,ra,e ^ haPPSnS " 3 m0Wte n0dS Which has •*•*» — *— a 
25 „nk to a new access node (in addition to an old link to an o,d access node) comes into 
range of a further access node. 

Referring to figure 15, data packets are being forwarded to the mobile host MH2 via the 
» r TOde BS3 ' additen '° da,a arrM "» at M H2 via the old link 

Z bT T BS2 ' 3 BS4 «- * ^ 

The mobrle host MH2 sends a trigger message to mis further access node BS4 TTre 

bigger message is identroa. to the bigger message sent previously to access node BS3 

The access node BS4 interprets the trigger message as an instruction to generate a 

unroas, drrected SR packet This SR packet is to .rave, along a unices, path be Jeen ft, 

•5 access node BS4 and the home access node BS2. tike before, as the SR pie 
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forwarded, each router adds an additional, secondary height into its routing protocol data 
table. 

Referring to figure 16, the SR is transmitted via nodes ER4, IR4, CR4 and IR3 to node 
5 ER3 which is the first router along the path back to the home access router BS2 that 
already has a secondary height stored in its routing protocol data table. If propagation of 
the SR packet was to cease now the secondary height of node ER3 would remain (- 
1,0,0,2,0:3 while that of node IR3 would have been set to (-1,0,0,5,i):S. In other words 
node IR3 would be upstream of node ER3 and it would not be possible to transmit data 
10 packets from node ER3 to node IR3 and onward to the access node BS4 for transmission 
to the mobile host MH2. Consequently, referring to figure 17, the routing protocol data 
table of node ER3 is updated to reflect its new secondary height of (-1,0,0,6,i):S. Node 
ER3 now has three downstream links; a primary one directed towards the home access 
node BS2 and also two secondary ones directed towards access nodes BS3 and BS4. 
15 Data packets arriving at node ER3 directed to MH2 are multicast, that is to say they are 
copied and a copy is forwarded to node ER2 along the primary link and copies are also 
forwarded to nodes BS3 and BS4 along the secondary links according to the process 
described above in relation to figure 19. 

20 Propagation of the SR packet continues to the old access node BS2, via nodes IR2 and 
ER2, updating their routing protocol data tables too. 

Data packets are now forwarded to mobile host MH2 via links from access nodes BS3 and 
BS4, in addition to data arriving at the mobile via the old link through home access node 
25 BS2. 

If the mobile host MH2 subsequently loses its links to access nodes BS3 and BS4 then, 
like before in relation to figure 13, it sends a message to the old access node BS2 
indicating such a loss of connection. The old access node BS2 generates a UUPD-S* 
30 packet and transmits it towards both access nodes BS3 and BS4. The packet follows the 
secondary paths established and causes the deletion of all secondary height entries in the 
routing protocol data tables of all nodes along the paths and all nodes immediately 
adjacent to nodes along the paths. 
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If, however, the link to access node BS3 is preferred or the links to access nodes BS2 and 
BS4 are lost then the mobile host MH2 sends a message to access node BS3. Handoff is 
tnggered by the access node BS3 generating a UUPD-S packet. Like before, in relation 
to figure 9, the UUPD-S packet is to travel along a unicast path between the access node 
5 BS3 and the home access node BS2 causing both the deletion of the old height entries 
and the promotion of the secondary height entries (by removing the ":S" suffix) in the 
roufng protoco. data tables of all nodes along the update path and all nodes immediate.y 
adjacent to the nodes along that path. It will be realised that if the UUPD-S packet was to 
s,mp.y travel to the home access node BS2 along the path between it and access node 

10 BS3 then the routers between BS4 and ER3 (namely BS4, ER4, IR4, CR4 and IR3) would 
ma.ntain secondary height entries in their routing protocol data tables. Since the link 
between MH2 and access node BS4 has been lost this is no longer desirabk. Therefore 
when the UUPD-S packet reaches node ER3, the UUPD-S packet is copied and modified 
to become a UUPD-S* packet which is to trave. along a unicast path between node ER3 

15 and the access node BS4 causing the deletion of the secondary height entries in the 
roufng protoco. data tables of all nodes a.ong the update path and all nodes immediately 
adjacent to the nodes along that path. 

It is to be appreciated that the above described embodiments are not intended to be 
20 hmfng, and that modifications and variations will be envisaged by the person skilled in the 
art. 



Although in the above described embodiments, the routing protocol assigns heights with 
packets flowing from a node having a high height to a low height, all such heights and 
25 adjustments to those heights could be inverted and data cou.d be required to flow from 
low heights to greater heights. 

The above-described embodiments describe a modified routing protocol based on the 
TORA routing protocol. However, aspects of the invention may be used to modify other 
30 known routing protocols, such as OSPF, RIP, etc. 

Furthermore, although in the above described embodiments the infrastructure of the 
Autonomous System is fixed, it is to be appreciated that one or more of the routers in the 
^structure may be mobile routers, such as used in the field of satellite communications 
35 and other systems in which one or more routers in the infrastructure are mobile in use ' 



